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Abstract 

We establish the existence of minimizers in a rather general setting 
of dynamic stochastic optimization without assuming either convexity or 
coercivity of the objective function. We apply this to prove the existence 
of optimal portfolios for non-concave utility maximization problems in 
hnancial market models with frictions (such as illiquidity), a hrst result 
of its kind. The proofs are based on the dynamic programming principle 
whose validity is established under quite general assumptions. 

Keywords, non-convex optimization; dynamic programming; non-concave 
utility functions; financial markets with frictions 


1 Introduction 

We study stochastic optimization problems in finite discrete time. The novelty 
is that we prove the validity of the dynamic programming principle and the 
existence of optimal strategies in cases where the objective function fails to be 
convex or coercive (Theorem [d]). Our main result extends the existence result 
of [H] by relaxing the compactness assumption and that of [53] by relaxing the 
assumption of convexity. 

Our motivation comes mostly from mathematical finance. In standard op¬ 
timal investment problems an agent tries to maximise her expected utility over 
available investment strategies. Utility functions are assumed concave in the 
overwhelming majority of the economics literature, starting already with [2]. 
This feature is usually justified by the risk aversion of the agents; see e.g. [13] 
or [T3J Chapter 2]. However, the alternative theory of [SD] [H] considered so- 
called “S'-shaped” utilities (which are convex up to a certain point and concave 
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beyond it). They also argued that investors distort objective probabilities in 
their decision-making procedures. 

There has been growing interest in non-concave utilities recently. Due to 
the mathematical difficulties, however, continuous-time studies focussed on the 
(rather unrealistic) case of complete markets where every contingent claim can 
be replicated; see [i H Ha H [i Hi]. In discrete time frictionless models 
also incomplete markets have been treated: one-step models were investigated 
in [laia and multistep ones in [Zlliai]. All these papers assumed frictionless 
financial markets. 

According to our knowledge, all existing results on optimal investment un¬ 
der frictions (transaction costs, illiquidity effects, etc.) assume a concave util¬ 
ity function; see e.g. [H [22 HD and the references therein. In [14] a gen¬ 
eral, continuous-time existence result was obtained under the assumption that 
trading costs are superlinear functions of the trading speed. In the analogous 
discrete-time multiperiod setting. Theorem [5] below provides an existence result 
for optimal investment in illiquid markets and with not necessarily concave util¬ 
ities. To the best of our knowledge, this is the first result involving non-concave 
utilities in markets with frictions. 

Sections |2 and [3] establish the existence of an optimizer in a general frame¬ 
work (Theorem 0]) and provide easily verifiable sufficient conditions (Lemma [5] 
and Theorem W). Sections [J] and |S] apply these results to prove the existence 
of an optimal portfolio in models of financial markets with or without friction 
(Theorem 111). 

2 Dynamic programming 

Let (D, T, {J^t)t=o, P) be a complete filtered probability space and let h be a 
normal integrand on K" x D, i.e. an extended real-valued yB(]R") (8).F-measurable 
function such that h{-,uj) is lower semicontinuous (Isc) for all w S D; see [331 
Chapter 14]. A normal integrand maybe interpreted as a “random Isc function”. 
Accordingly, properties of normal integrands are interpreted in the P-almost 
sure sense. For example, a normal integrand h is convex, positively homoge¬ 
neous, positive on a set C C R", ... if there is an A G P with P{A) = 1 such 
that h{-,uj) is convex, positively homogeneous, positive on C, ... for all uj G A. 
This is consistent with the convention of interpreting inequalities etc. for ran¬ 
dom variables in the P-almost sure sense. Indeed, random variables may be 
viewed as normal integrands which do not depend on x. 

For a cr-algebra Q C if we denote by P°(D, Q, P; R‘^) the set of t/-measurable 

valued random variables, L^{Q) is a shorthand notation for L°(D, 17, P; R^^) 
with d being clear from the context, L^{il,0,P) denotes the set of integrable 
R-valued random variables. 

We will study the dynamic stochastic optimization problem 


minimize 



over X € N, (P) 
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where N := {(xt)^g \ xt S L°(0, P;R"*) for given integers rit such that 
rig + • • • riT = n. We assume throughout the article that there is an m G 
L^(r2,P, P) such that h > m. 

Given a sub-cr-algebra Q ^ the conditional expectation E^h of h is a 
0-normal integrand such that 

{E^h){x)=E^h{x) 'ix&L°{n,g,P-W'). 

The next lemma follows from [ini Corollary 2.2]. 

Lemma 1 (|10)1. Let Q Q E be a sigma-algebra. Then h has a well-defined 
conditional normal integrand E^h that is bounded from below by E^m. 

We will use the notation Et = E^* and x* = (xg,..., Xt) and define extended 
real-valued functions ht^ht '■ x R recursively for t = T,..., 0 by 

hj' = /i, 

ht — El ht^ ^1] 

ht-i{x^~^ ,Lo) = inf ht{x*~^,xt,uj). 

rct£R”t 

In order to guarantee that the above recursion is well defined and that optimal 
solutions exist, we will need to impose appropriate growth conditions on the 
functions ht- Like in [23], our conditions are given in terms of the recession 
functions of ht- Here, however, we are dealing with nonconvex functions so we 
will use the notion of a horizon function from [28] which extends the notion of 
a recession function to the nonconvex case. 

We now recall some terminology from [28] . A function g : R" —>• R is proper 
if it does not take on the value —oo and it is not identically -boo. The set 
domg := {x € M" j g{x) < oo} is called the effective domain of g. The horizon 
function of g is the positively homogeneous function defined by 

g°°{w) := lini inf Xg{w'/\), 

(5\0 xe(o,(5) 


where B(r(;,(5) denotes the closed ball of radius 5 around w. 

In some important situations, the horizon function may be expressed as 


g°°{w) =liminf 

OL OO 


g{aw -b w) 
a 


( 2 ) 


for some w G R". 

Given a set C, we denote by 5c the indicator function of C, i.e. 5c (x) = 0 
if X € C and 5c(x) = -boo otherwise. 

Example 1. If g is proper convex Isc function, then, by 1281 Theorem 3.21], 

oo( N r g{aw + w) g{aw + w) - g{w) 

g [w) = lim - = sup - 

a oo Ct a>0 Of 
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for any w € domg. Expression m holds also for proper Isc functions on the 
real line with any w S K.. Indeed, for w > 0 (analogously for w < 0), we see 
from the definition that g°°{w) = (g + Ss_^)°°{w), so the positive homogeneity of 
g°° and the expression in 1281 Theorem 3.26] give 

g°°iw) = W( 7 °°(l) = wliminf ^ =liniinf^^^. 

Q'/^oo Q oc oo Q 

Applying this to the function gw{w) := g{w+w) and using the fact that gi^ = g°° 
(see flSl p. 89]) proves the claim. 

For proper convex Isc functions, one has {gi + ( 72 )°° = + 5 “ whenever 

domgi n dom (72 7 ^ 0- More generally, we have the following. 

Lemma 2. Let gi and (72 be proper Isc functions with proper horizon functions. 
Then {gi + ( 72 )°° > <?i“ + g^■ If gi is convex and (72 is satisfies ([2]) with some 
w S domgi fl dom( 72 , then 

igi+g2r = gr + 9T 

and gi + (72 satisfies m with the same w. 

Proof. We always have 

(51 + 52 )°°(w) = lim inf [Xgi{w'/X) + Xg 2 {w'/X)] 

(5\,0 Ae(o,<5) 

inf Xgi{w'/X)-\- inf Xg 2 {w'/X) 

Ae(0,<5) Ae(0,5) 

= g]°{w)+g^{w). 

By shifting the functions if necessary, we may assume that w = 0 and 51 (0) = 0; 
see [28l p. 89]. Then, under the additional assumptions, 

(51 + g 2 )°°{w) < lim inf [Xgi{w/X) + Xg 2 {w/X)\ 

(5\,0 Ae(0,(5) 

< sup Aglfw/A) + lim inf Xg 2 (w/X) 

\>0 i5\,0Ae(0,5) 

= griw) + griw), 

where the last equation follows from convexity of gi; see Example [H The above 
also shows that gi + (72 satishes (l2|) with w = 0. □ 

By [551 Exercise 14.54], the function h°° defined by h°°{-,uj) is a normal 
integrand. 

Lemma 3. Assume that h]°{0,xt) > 0 for all xt 7 ^ 0. Then ht-i is a normal 
integrand and 

hf]_i{x*~^ , Lu) = inf h]°{x^~^,xt,uj). 

Xt 

Moreover, given an x € N, there is an Tt-measurable Xt such that 
ht-i{x^~^{u}),uj) = ht{x*~'^{uj),Xt{oj),uj). 


> lim 
(5\,0 
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Proof. By Theorem 3.31], the horizon condition implies that ht is level- 
bounded locally uniformly in and that the expression for the horizon func¬ 
tion is valid. By |28l Theorem 1.17], the infimum in the definition of ht-i is 
attained. By [351 Proposition 14.45(c)], the function p(a;, w) := (uj), x, uj) 

is an J^t-measurable normal integrand so, by [281 Theorem 14.37], the minimizer 
Xt can be chosen J^^-measurable. By [281 Proposition 14.47], ht-i is a normal 
integrand. □ 

With the help of the lemmas above, the following theorem is proved analo¬ 
gously to |23l Theorem 1]. 

Theorem 4. Assume that hf°(Q,xt) > 0 for all xt ^ 0 whenever ht is well- 
defined. Then ht is well-defined for all t = T,... ,0 and 

Eht{x^) > ini t = 0,..., T Vx G A/”. (3) 

Optimal solutions x € J\f exist and they are characterized by the condition 

Xt{oj) & avgniinht{x*'~^ {uj),xt,uj) P-a.s. t = 0, ...,T, 

Xt 

which is equivalent to having equalities in ©• 

Proof. By recursive application of Lemmas [1] and |31 ht and ht are well-defined 
normal integrands. For x G A/", we have 

Eht{x*{uj),uj) > Eht-i{x*~^{uj),uj) = Eht-i{x*~'^{uj),uj) t = l,...,T. 

Thus, 

Eh(x{u}),u}) = Ehrix^{w),w) > Eht)(x^{u}),u}) > E inf /io(a;o,a;), 

where the inequalities hold as equalities if and only if 

ht{x*{u:),u:) = ht-i{x^~^{uj),uj) P-a.s. t = 0, ...,T. 

The existence of such an x € Af follows by applying Lemma [3] recursively for 
t = 0,...,T. □ 

The above result is closely related to [12] where it was assumed that the sets 
{x G K." I h{x, to) < a] are compact for every oj G and a G M. In Theorem |4| 
this has been substituted by the assumption on the horizon functions, which 
is equivalent to the sets {xt G K”* \ht{xt,uj) < a} being compact; see [351 
Theorem 3.26]. As we will see in the following sections, our assumption allows 
for reformulations that turn into well known no-arbitrage conditions in models 
of financial economics. 

The following lemma gives a sufficient condition for the growth condition in 
Theorem U) 
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Lemma 5. We have h^{0,xt) > 0 for all Xt ^ 0 provided that 

{x € Af \ h°°{x) < 0} = {0}. 

Proof. We proceed by induction on T. Assume first that the claim holds for the 
(T — l)-period model. Applying Lemmas [T] and [3] backwards for s = T,..., 1, 
we then see that ho is well defined. Lemmas [3] and [5] give 

{a:o G L°{To) I h'^{xo{u;),u}) < 0 a.s.} 

C {xo G L^^Tq) I h^{xoiuj),uj) < 0 a.s.} 

= {xo G L°{J'o) I inf /i“(xo(w), xi, w) < 0 a.s.} 

Xi 

= {xo G L°(Jb) I 3x G A/": xq = h“(x^(w), w) < 0 a.s.}, 

where the last equality follows by applying the last part of Lemma [3] to the 
normal integrand h°°. Repeating the argument for t = 1,..., T, we get 

{xo G L°{To) I h'^{xo{oj),oj) < 0 a.s.} 

C {xo G LP{To) I 3x G a/" : Xo = a:o, h°°(x(a;),a;) < 0 a.s.} = {0} (4) 

Thus /i“(xo) > 0 almost surely for every xq ^ 0, since otherwise there would 
be a nonzero x G L°(Ab) with hg°(x) < 0; this contradicts (|3]). For a one-period 
model, the claim is proved similarly. The same argument with xt and A} in lieu 
of Xo and Aq allows us to conclude. □ 

The following lemma was used in the proof of Lemma [51 

Lemma 6. Let h he a normal integrand that is bounded from below by m & . 

We have E^h°° < {E^h)°° and 

{x G L°{g) I {E^h)^ix) < 0} C {x G L°{g) I h“(x) < 0}. 

Proof. The function 


j Xh{x/X,uj) if A > 0 
h{X,x,uj) = < h°°{x,uj) if A = 0 

[ - 1-00 otherwise 

is clearly xK”) x A'-measurable, and it is lower semicontinuous w.r.t. (A, x); 
this can be deduced as in [351 Exercise 3.49]. Thus h is a normal integrand and, 
by construction, 

h°“(x,a;) = lim inf hiX.x.uj). 

5\,0 Ae[0,5].a:eB(x,5) 
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Let X G LP(Q) and A&Q. We have that 


E[lAh°° ix)] = E\lAVmv inf /i(A,a:)] 

5\.0 AG[0,5],a;GB($,5) '' 

= lim inf h(A,a:)] 

<5^0 Ag[0,<5],xGB(x,5) 

< lim inf E\lAh{\,x)\ 

<5\0 AgL“(S;[0,<5]),xGL‘>(6;B($.5)) 

= lim inf E[lA{E^h){\,x)\ 

<5\0 AGL'>(G;[0.5]).a;GL‘>(e;B(s,<5)) 

= \iuYE[\A inf {E^h)i\,x)\ 

<5X^0 AG[0.5]).a;GB(S,5) 

< lim Liflyi inf XiE^h){x/X)\ 

<5\0 AG(0,<5)),a;GB(S,<5) 

= E[lA{E^h)’^{x)\, 

which gives E^h°° < {E^h)°°. Here the second and the last equality follow 
from monotone convergence, and the fourth follows from the interchange rule 
[551 Theorem 14.60]. 

To prove the second claim, let x G L^{Q) such that {E^h)°°[x) < 0. By the 
first claim, E^h°°{x) < 0 almost surely so, by the definition of a conditional 
integrand, 

iE^h°°)ix) = E^h°°ix). 

Since h°° > 0, we have h°°{x) < 0 almost surely if and only if E^h^(x) < 0 
almost surely. □ 


3 Existence of solutions 

This section gives the main result of the paper, which is a general existence result 
for nonconvex dynamic optimization problems. This is a nonconvex extension of 
the existence result in Theorem 2], which in turn extends well-known results 
in financial mathematics on the existence of optimal trading strategies under 
the no-arbitrage condition. Applications to optimal investment with nonconvex 
utilities will be given in Sections |4] and [5] below. 

Recall that a set-valued mapping S' : H R" is measurable if S“^(0) G E 
for every open O C R". Here S~^{0) := {w G H | S(w) n O ^ 0} is the inverse 
image of O. 

Theorem 7. Assume that there is a measurable set-valued mapping TV : H ^ R” 
such that N{u}) is a subspace for each lo, 

{x & M \ h°°{x) < 0} = {x G A/" I cc G N}, 

and that Eh{x -I- x') = Eh{x) for all x, x' G A/" with x' € N almost surely. Then 
optimal solutions exist. 
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Proof. By [501 Lemma 5.3], there exist J^t-measurable set-valued mappings Nt 
such that Xt € Nt) if and only if xt = Xt for some x £ Af with x £ N 

and x*~^ = 0. Let 

h{x,uj) = h{x,uj) -t (5r(c,;)(a;), 

where L = x • • • x and N^{uj) denotes the orthogonal complement of 
Nt{uj). 

Let us show that for every x £ Af, there exists x £ Af such that 

Eh{x) = Eh{x). (5) 

Let xq be the projection of xq to N^. Since Xg and Ng are J^j-measurable, xg 
is J^o-measurable |28l Exercise 14.17]. By definition of Ng, there exists x £ Af 
with X £ N and xg = — (so — xg) £ Ng. By assumption, Eh{x) = Eh{x + x). 
Moreover, {x -I- i)o = xg £ N^j-. We may repeat the argument for t = 1,..., T 
to construct x £ Af with the claimed properties. Since h> h and ([SI) holds, we 
have that minimizers of Eh minimize Eh. We can now complete the proof by 
applying Theorem 0] to h. 

It remains to check the conditions of Lemma 0] for h. Clearly, i5]l° = 5r. By 
Lemma m h^ > h°° + i5r, so 

{x £Af \ h°^{x) < 0} C {a; G AT I h°°{x) <0, x £ L}. 

An element x of the set on the right has both xg £ Ng and xg £ N^ and thus, 
Xg = 0. Repeating the argument for t = 1,..., T, we get x = 0 and thus, 

{x £ Af \ h°°{x) < 0} = {0}. 

By Lemma O the existence now follows from Theorem 0] □ 

Let /i be a convex normal integrand and let {x G A/" | h°°{x) < 0} be a linear 
space. Then the condition of Theorem [7] is satisfied with 

N{uj) = {x G K” I h°°{x,uj) < 0, h°^{-x,uj) < 0}. 

Indeed, this set is linear and, by m Corollary 8.6.1], h{x + x',u}) = h{x,uj) 
for all x' G N{oj). We thus recover the existence result of [521 Theorem 2]. 
Applications to nonconvex problems will be given in Sections 01 and 01 below. 


4 An application to mathematical finance 

This section applies Theorem [71 to the problem of optimal investment in illiquid 
financial markets. We consider the discrete-time version of the model in |14] : 
see also 0]. 

Let Zt, t = 0,..., T be an adapted sequence of {d — l)-dimensional random 
variables representing the marginal price of d — 1 risky assets in an economy. 
We imagine that if “very small” amounts of asset i were traded then this would 
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take place at the price Zl at time t. We assume that the riskless asset in this 
economy has a price identically 1 at all times. 

As in Carassus and Rasonyi [5], we model trading strategies by predictable 
processes (j) = where denotes the portfolio of risky assets held over 

[t — l,t]. Thus A(/)t = (j)f — is the portfolio of risky assets bought at time 

t — 1 and </<( = 00 + Y^\=i A0i. In perfectly liquid markets, the corresponding 
“value process” starting at initial capital x is given by 

t 

+ -AZ,. 

In order to model illiquidity effects, we first rewrite the above as 

t 

1=1 

with the convention Z-i = 0. As usual, the last term is interpreted as the 
liquidation value one would obtain by liquidating the portfolio at time t. Un¬ 
der illiquidity, it is more meaningful to track the position on the cash account 
without assuming liquidation at every t. We denote the cash position held over 
by X°. 

If illiquidity costs at time t are given by an J^j-normal integrand Gt : x 

n —^ K+, we have that the change in the cash position at time t — I is 

AX° = Acj^t ■ Zt-i - 

(recall that A0t is the portfolio of risky assets bought at time f — 1). Summing 
up, we get 

t t 

:= X° - ^ A0, • Z,_i - ^G,_i(A0,). 

i=l i=l 

Note that the A0i are control variables here while is the controlled process. 
We assume that the functions Gt are convex in the first argument and 


lim > 

-Zt{oj) ■ z. 


(6) 

cn—>-oo a 


lim > 

a->-oo a 

-Zt{io) ■ z, 


(7) 


These conditions hold in particular if liquidity costs are superlinear in the vol¬ 
ume; see Guasoni and Rasonyi M- The above condition allows also for free dis¬ 
posal of all securities in the sense that the total cost St{z, oj) := Gt{z, uj)-\-Zt{uj)-z 
is nondecreasing with respect to the partial order induced by This is quite 

a natural assumption e.g. in most securities markets where unit prices are always 
nonnegative. 

We will consider an optimal investment problem of an agent whose financial 
position is described by a random endowment W. We allow both positive and 
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negative values so W can represent financial liabilities as well. The investor’s risk 
preferences are described by a possibly nonconcave utility function u : R —)• R. 
We will assume that u is upper semicontinuous, bounded from above and that 

limsup <0 Vw < 0. (8) 

a—>-oo Oi 

For piecewise concave u, clearly holds; see [5] for such a setting. 

An application of Theorem [3 yields the following existence result; see Ex¬ 
ample H] below for the proof. 

Theorem 8. For an investor with initial capital Xq = z and zero initial stock 
position d>g = 0, j = 1,..., d — 1 there exists an optimal strategy (jf with 

sup Eu{X^{<j3) + W) = Eu{X^{(j3*) + W). 

<t> 


Remark 1. A similar result has been obtained in Theorem 5.1 of m , in a 
continuous-time setting. However, in the discrete-time case, Theorem [8] above 
goes much further. In [14] u was assumed concave while we do not need this 
assumption here. Also, in [14] \Gt{x)\ was assumed to dominate (constant times) 
a power function |x|“ with a > 1 while here we only need m and 0. 


5 Models with general convex cost functions and 
portfolio constraints 

This section extends the above existence result to a market model which does not 
assume the existence of a cash account a priori. In a market without perfectly 
liquid asssets it is important to distinguish between payments at different points 
in time which are described by an adapted sequence c = (ct)^o of claims, each 
Ct payable at time t. As in |22j . we assume that trading costs are given by an 
adapted sequence (S't)^o of convex /'j-normal integrands with St{0,uj) = 0. 
We also allow for portfolio constraints given by an adapted sequence of 

closed convex sets, each containing the origin. We assume that Dt = {0}, i.e. 
that the agent liquidates her portfolio at the terminal date. 

We will describe the agent’s preferences over sequences of payments by a 
normal integrand V : R^+^ x H —>■ R. More precisely, the agent prefers an 
adapted sequence over another d^ if 

EV{d^) < EV{d^), 

i.e. V (d) expresses the disutility of d. The agent is indifferent between d^ and 
if the two expectations are equal. We allow V{-,uj) to be nonconvex but assume 
that it is bounded from below by an integrable random variable, V{0,uj) = 0 
and that V is nondecreasing in the sense that if d^ —d^ € then V(d^,uj) < 

V(d^,uj). 
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Assumption 1. The functions V{-,uj) satisfy ([5]) with ic = 0 for all w G fi, and 

V°^{d,uj) <0 ^ 

Remark 2. The above conditions on V hold in particular under the extended 
Inada condition 


Indeed, since 


0 < V°°{d,uj) < liminf 

a oc 


V{ad, uj) 


it suffices to note that the equality holds on since V{Q,w) = 0 and V{-,ui) 

is nondecreasing in the directions of]SF'^^. 

The optimal investment problem can now be written as 


minimize EV{S{Az)+c) over zGAId, (9) 

Md '■= {z G Af \ Zt € Dt} denotes the set of feasible trading strategies, Z-i := 0 
and S{Az) denotes the adapted process {St{Azt{oj), uj))JAq of trading costs. 
Here Zt denotes the portfolio of assets held over {t, t + 1]. In the notation of the 
previous section zt = {X^j^i,(j3t+i)- 

Example 2. Problems where one is only interested in the level of terminal 
wealth fit with 


V{d,u)) 


Vridr, uj) if dt <0 for t <T, 
+00 otherwise, 


where Vt is a normal integrand onRxH. Such a function satisfies Assumption[l\ 
as soon as 

liminf ^T{adT,u;) ^ ^ ^ ^ 

a oo Ck 

Indeed, V{-,uj) is now the sum of the indicator function ofMff x K. and g 2 {d) := 
VT{dT,uj). Being a Isc proper function on the real line, Vt{-,ijj) automatically 
satisfies m ; see Example [H It follows that 


g^{d) = lim inf XVT{dx/X) 
S\0 xe(o,«) 
d' ^ 3 (d,S) 

= lim inf \VT{d'rp/\) 

5\0 Ae(o,5) 

d'j, 

= V^idr) 

= lim inf 

a oo Ck 

a oo Ck 
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so g 2 satisfies @ with w = 0 as well and cni) means that g^{d,u:) <0 iff dx < 
0. Lemma\^ implies that {■, uj) = SgTy^g^+g^, so (fTOl) implies Assumption\^ 
Problem (ED can now be written with explicit budget constraints as 

minimize EVt{St{^zt) + ct) over zgMd 

subject to St{Azt) + ct < 0, t = 0,...,T—l. 


The existence result below involves an auxiliary market model given by 

ooo, ^ St{ax,uj) 

(a;,a;) = sup-, 

a>0 


D^icu) = f| aA(u;). 


a>0 


By [281 Theorem 3.21], is the horizon function of St{-,U!) while by [28l 

Theorem 3.6], D°°{ijj) coincides with the horizon cone of Dt{uj) defined in 
Section 3.B]. 

Theorem 9. If {z G Md°° \ S°°{Az) < 0} is a linear space, then the infimum 
in ED is attained. 

Proof. In order to apply Theorem |7l we write (O as 

minimize EV (d) over z G Nd , d G Af 
subject to S'(Az) + c < d, 


where dt denotes the total expenditure at time t (alternatively, one could apply 
the results of m on composite mappings). This fits (O with x = {z,d) and 
h{x,oj) = V{d) + Sc{uj) {x ), where 

C{uj) = [x I St{Azt,uj) + ct{uj) < dt, zt G Dt(ui)}. 

By Lemma m Assumption |T] and the fact that 0 G C{u)) imply h°°[x,oj) = 
V°°{d,uj) Since = (5c“(c^)) [211 Exercise 3.12] and [^ Exer¬ 

cise 3.24] give 

,oo( a Sf°{Azt,uj) < dt, Zt G 

’ 1 +00 otherwise. 


Our assumptions on V imply that E°°(d, w) < 0 if and only if d G so 

{x G Af\h°°{x) < 0 a.s.} = {xGAf\ E“(d) < 0, z G D°°, S°°{Az) < d} 

= {cc G TV] d < 0, z G D°°, S°°{Az) < d} 

= {x G A/"] d = 0, z G £>“, S'°°(Az) < 0}, 

where the last equality follows from the fact that —S°°{—Az) < S°°{Az) (be¬ 
cause Sf^{-,u}) is sublinear) and the assumption that {z G Md°° \ S°°{Az) < 0} 
is linear. Defining 


L{u}) = {x G R” 1 d = 0, Zt G D°^{uj), Sf°{Azt,uj) < 0} 
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we thus have that the conditions of Theorem Hare satisfied with N{uj) = L{uj)n 

[-L(w)]. □ 

The following example specializes Theorem H to optimization of terminal 
utility and market models with a cash account. 

Example 3. Consider again the setting of Example\^ and assume that there is 
a perfectly liquid asset, say asset 0, such that, denoting z = (z°,5), 

Stiz, w) = + Stiz, uj) 

and Dt{uj) = K. x for t = 0,..., T — 1 while still Dt = {0}. The problem 

can then be written as (fix an adapted z and minimize over adapted z^) 

/ T ^ \ 

minimize EVr [ ^ 5t(Azt) + ^ ct ] over z&Nd- (H) 

\t=o t=o ) 

The linearity condition of Theorem H means (by Lemma that 

{z e A/" I <0, ~z&b°°, = 0} (12) 

is a linear space. This holds, in particular, if 

5“>0 and 5t(z)“ >0, Vz^M;!. (13) 

Indeed, the first inequality implies Az° < 0 and then z° = 0 since zfi = 0, by 

assumption. Then, the second inequality implies Az^ < 0. Since z_i = 0 and 
Dt = {0}, by assumption, this can only hold if z = 0. 

The proof of Theorem |8] is now a simple application of the above example. 

Example 4 (Proof of Theorem [5|). When Vt{c,uj) = —u(—c,uj), St(z,Lo) = 
Zt{uj) ■ z + Gt(z, uj), Co = X^, ct = —W and c* = 0 for t = I,... ,T — 1, 

Dt := t = 0,... ,T — 1, Dt '■= {0}, we can write problem (ITTI) as 

maximize Eu — ^[ZfA~zt + Gt{A~zt)] + W^ over z G Md ■ 

This is exactly the problem formulated in Section \^where the notation ft = ^t-i 
was used. Conditions cni) and now become the conditions on G and u given 
in Section(^ Indeed, since St{-,U!) are convex, ca) becomes (O and © ; see 
Example H 

The linearity condition in Theorem H applies also to the frictionless case. 
Indeed, in the classical perfectly liquid market model, it becomes the classical 
no-arbitrage condition. In nonlinear unconstrained models, is becomes the ro¬ 
bust no-arbitrage condition introduced by Schachermayer |29j : see m Section 4] 
for details. The linearity condition in Theorem H may hold even without no¬ 
arbitrage conditions. One has {z G N'd°° \ S°°{Az) < 0} = {0}, for example, 
when S is such that Sf°{z,u}) > 0 for all z R:0. Indeed, S(Az) < 0 then 
implies Azt < 0 componentwise, which must hold as an equality since, by as¬ 
sumption, x-i = 0 and Dt = {0}. Such a condition holds e.g. in limit order 
markets where the limit order books always have finite depth. 
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